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The invention relates to multimedia documents that 
are installed in data-processing systems. 

It is known that a multimedia document can be 
considered as being in the form of a set of objects of an 
object-oriented program installed in a data-processing 
system, and as illustrated in particular by the 
publications relating to the work performed by the 
"Multimedia / Hypermedia Expert Group" with a view to 
defining the MHEG international standard. 

The objects that are contained in a multimedia 
document and which can be very different, in particular 
in terms of the dynamic aspects of the document, can thus 
be taken into account in unified manner. 

It can be desirable to impart dynamic aspects to a 
multimedia document, i.e. to make the behavior of the 
component elements of the document vary as a function of 
events (e.g. a timer event based on a clock) . 

Furthermore, the multimedia document can be 
interactive, i.e. the behavior of its component elements 
can be varied as a function of events generated by a 
user. It follows from these definitions that a 
multimedia document that is "interactive" is "dynamic" to 
an even greater extent . 

Currently, in order to have properties that are 
dynamic (and even more so interactive) , a multimedia 
document can be designed and produced only by a 
programmer, whenever the control to be provided exceeds 
an elementary level . 

Such an elementary level corresponds, for example, 
to the level expressed by the concept of an anchor, i.e. 
the level of a GOTO-type instruction in which the 
destination is given in the document itself, and where 
the instruction is taken into account conventionally by a 
browser, such as Netscape or Internet Explorer, 
version 4 . 



2 



One existing solution for making a multimedia 
document dynamic is described in an article entitled 
"Synchronization Attributes and Rules of Active Object- 
Oriented Database for Multimedia Presentation" by Seok 
5 Joe Yun and Woo Saeng Kim, published in "Database systems 
for advanced applications * 95 . Proceedings of the fourth 
international conference on database systems for advanced 
applications, Singapore, ISBN 981-02-2220-3. That 
article describes a method of producing a dynamic 

10 multimedia document, i.e. a method that manages any 

variation in the component elements of the multimedia 
document as a function of timer-type events. That method 
consists in implementing the multimedia document in the 
form of a program that is object-oriented (in the object- 

15 oriented programming sense) . Each object is associated 
with a respective element of the document, and each 
attribute of an object is associated with a status of the 
element in question (color, run-speed for an animation, 
etc . ) 

20 Furthermore, that article teaches that the 

attributes can be associated with a formalism of the 
event -condition-action (EGA) type. 

Unfortunately, in view of the needs generated by the 
development of communications via communications networks 

25 of the Internet and Intranet types, the need to use a 

programming specialist to draw up a multimedia document, 
from the above-mentioned elementary level upwards, cannot 
remain acceptable for long, because it generates cost 
that is prohibitive for communications network users who 

3 0 wish to make dynamic multimedia documents available to 
the public. 

4jpsl^^ /Moreover , such technology is ill-suited to such 
communV cat ions networks. Such networks make it possible 
to inteVconnect data-processing systems that are 
3 5 heterog^eous . Among such systems, it is possible to 
encounteA systems that have particularities as regards 
the presen\ation of multimedia documents, and, in 
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particular, limitations on the dynamic and/or interactive 
aspects. For example, mention may be made of the case of 
a passive terminal that has no means of interaction (such 
as a keyboard, a mouse, etc.) and that cannot therefore 
5 implement the interactive aspects of such a multimedia 
document . 

The solution described in the article in question 
does not make it easy for the representation of the 
document to be adapted to accommodate the particularities 

10 of the data-processing system, because once the object- 
oriented program has been compiled, it can no longer be 
modified . . ^^wv 
1"^ Gin order to solve those problems, the invention 

firstly provides a method of dynamically representing a 

15 multimedia document in a data-processing system via a 

software module, said multimedia document being made up 
of a hierarchically-organized set of elements themselves 
having attributes, at least one of said attributes being 
associated with an event-condition-action or "EGA" type 

20 formalism (or link) , said method being characterized in 
that it comprises the following ordered steps: 

describing said multimedia document in a description 
1 anguage ; and 

having said multimedia document interpreted by said 

25 software module, said EGA formalisms being interpreted 
dynamically so as to enable the representation of said 
multimedia document to be varied by means of actions 
being performed as a function of events and of 
conditions . 

3 0 The invention also provides the multimedia document 

itself, i.e. a multimedia document made up of a 
hierarchically-organized set of elements themselves 
having attributes, at least one of said attributes being 
associated with an event-condition-action or "EGA" type 

35 formalism. The multimedia document is characterized in 
that it is described in a description language, and in 
that said EGA formalisms are described in a manner such 
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as to enable them to be interpreted by a software module 
so as to enable the representation of the multimedia 
document to be varied by means of actions being performed 
as a function of events and of conditions. 
5 ^?>f^*^^^^{ie'^ Invent ior^^ its characteristics, and its 
advantages appear more clearly from the following 
description given with reference to the sole figure 
which, by way of example, shows a small subset of 
elements relating to a dynamic multimedia document. 

10 / As indicated above, this figure corresponds to a 

representation of a portion of an interactive multimedia 
document considered to be in the form a set of elements 
installed in a data-processing system. 

The data-processing system includes at least one 

15 programmed computer processing unit which may optionally 
be constituted by a single computer and/or which may be 
part of a vast ensemble in which units can communicate 
with one another via one or more communications networks, 
as is known, 

2 0 The dynamic multimedia document shown includes a set 

of optionally-displayable elements which, by way of 
example, are symbolized by a graphics element 1, i.e. an 
element that can be displayed, entitled "play button" , by 
a graphics element 2 entitled "pause button", and by an 

25 element 3 assumed to be non-displayable and entitled 
"video" . The document in this example is thus a 
multimedia document that is interactive (and therefore 
dynamic) . 

SA^^A addition, it is possible to organize the elements 
30 in hierarchical manner. More precisely, it is possible 
to definee certain "composite" elements which encompass 
one or moVe "contained" elements. For example, the 
buttons rei^renced 1 and 2 may be "contained" elements 
which are encompassed in a "composite" element that may 
35 optionally b^displayable . 

In this example, attributes of the various elements 
are constituted by "statuses" which express their 
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respective states and therefore the respective states of 
the various portions of the document, such as a status 4 
expressing the selection state (selected or not selected) 
of the play button 1, and a status 6 characteristic of a 
5 playing state (playing or stopped) of the video 
element 3 . 

A status, e.g. the status 4, goes from a false state 
to a true state or vice versa as a result of the 
occurrence of an event which is itself the result of the 

10 behavior of an element. 

This thus makes it possible to interconnect the 
elements via events, each of which can be considered to 
be a change of state relating to an element attribute. 

Thus, in the example considered above, a change in 

15 the value of the status of the element 3 is, for example, 
conditioned by a change in the value of the status of the 
element 1, which change is induced by a particular event. 
This event which connects the element 1 to the element 3 
may, for example, be the detection of a modification in 

20 status for the "selection" attribute of the element 1, 
when this status goes from false to true, for example. 
For example, the "selection" attribute may be true when 
the corresponding button (button 1 in this example) is 
selected by a user (e.g. via a graphics pointer 

25 associated with a mouse), and be false otherwise. 

In a particular implementation of the invention, the 
modification is detected by the element 1 itself. 

Thus, for example, a user acting on the "play" 
button for starting a video is considered to result in a 

3 0 change in the value of the "play" button whose 

"selection" attribute goes from false to true and 
triggers a start action thereby causing the video to 
start playing. Such a start action assumes that there is 
an attribute at the video element which is, for example, 

35 a "play" or "run" element and causes a change in status, 
at least for this attribute. 
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It is thus possible to construct a complex scenario 
that unfolds in steps, each of which leads from one 
element to another as a function of the changes in status 
that take place successively at the elements, and that 
5 cause said elements to act on others at which they in 
turn cause changes in status . 

However, such changes may be dependent on conditions 
that are imposed and that must be satisfied. Thus, in 
the above -considered case, a condition that must be 
10 satisfied in order for the video to be started may be 
that the availability of a video program must be 
verified, for example. 

To this end, in the invention provision is made for 
a dynamic multimedia document to be implemented in the 
15 form of a hierarchically-organized set of elements, in 

which set each elem.ent is provided with attributes. Each 
attribute may be associated with an event -condition- 
action (EGA) type formalism, as known to be implemented 
in industrial programmable logic controllers. 

2 0 Interpreting such formalisms makes it possible for the 

representation of the multimedia document (i.e. in 
general its visual or audio appearance) to be varied by 
means of actions triggered by events when conditions are 
satisfied. 

25 As indicated above, an event is considered as 

corresponding to the fact that a change in the value of a 
status relating to an element is detected by said element 
as a function of a trigger. An example of an elementary 
trigger referenced 7 is given on the accompanying sole 

30 figure for the target constituted by the play button. As 
summarized in the figure, the elements taken into account 
to determine selection of the play button 1 are as 
follows : 

- Target: play button . select ion status 

3 5 - Preceding value operator: equal 

- Preceding value: not selected 

- Current value operator: equal 
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- Current value: selected. 

An event may thus be considered to be determinable 
merely by a limited comparison between a preceding value 
and a current value of the same status . 



determined time lapse for a determined element, with a 
determined three-dimensional position of an element, or 
with the execution of a procedure, and it may then be 
expressed by a value threshold being crossed. It may 

10 also be the result of an external action for selecting an 
element from the set of elements of the multimedia 
document in question. 

A condition can be represented by a logic expression 
that combines the current status values for determined 

15 elements of the set making up the multimedia document in 
question. The model takes into account the fact that an 
event is not always sufficient on its own to cause an 
action to be triggered, and that it may be necessary to 
subject an action to the prior condition of verifying 

20 that determined constraints are satisfied. In many cases 
a condition may be represented by a simple logic 
expression . 

By way of example, a "running" condition may be 
reduced merely to determining whether a condition is true 
25 or false relative to the current values of a first status 
of the play button element 1 and of a second status of 
the video element 3 . 

In general, a condition may be described using the 
following simplified structure which provides: 
30 a target constituted by the status at which the 

condition must be satisfied; 

a comparison operator; and 

a threshold value determined for the status that is 
being taken into account . 
3 5 By way of example, and as shown diagrammatical ly in 

the figure, the elementary condition 9 expressing the 
fact that a stop button of a video can be selected if and 
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An event may, in particular, be associated with a 
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only if a state of preparation has been reached that is 
sufficient for the video to be running, may merely be 
written in the following form: 

<video, playing status, equal, running> 
5 An action results in a change in particular in 

appearance or behavior in the multimedia document that it 
affects, if the condition fixed when the document was 
written is satisfied. 

Any action results in the status of some element 
10 being modified, it being possible for the status 

modification itself to constitute an event that is taken 
into account in some other element of the set of elements 
making up a multimedia document. 

An action acts directly on a single element only of 
15 the set of elements specific to a multimedia document 
(although this element may optionally be a "composite" 
element) . For example, an action may be defined using 
the following simplified structure which provides: 

a target which indicates the element status on which 
20 the action must be directed; and 

a value which specifies the new value of the 
targeted element status. 

In the example shown in the figure, the target of an 
action referenced 10 is thus a play status of the video 
25 element, and the action is developed for a "play" value 

of a determined level which must be exceeded in order for 
the video to start playing in the data-processing system 
in question. 

In this example, a link 8 is provided for the subset 
30 shown in the accompanying sole figure. The link brings 

together the events, conditions, and actions that concern 
the subset, and it has a simplified structure which 
comprises : 

one or more events, referenced 7 ; 
35 one or more conditions, referenced 9; and 

one or more actions, referenced 10. 
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As already indicated above, modifying a status 
relating to an element of a multimedia document of the 
invention results in an action, when a condition 
authorizing the action is satisfied. The action itself 
5 results in a modification of a status at another element, 
and it is possible to consider the use of a set of 
elements making up such a multimedia document as being 
conditioned by a succession of changes in statuses, i.e. 
states, each of which concerns a respective element. 

10 Each change in status at an element can result in an 
action being performed on another element following a 
chain reaction defined by a link, i.e. an event- 
condition-action (ECA) proposal or formalism, or 
optionally a composition of ECA proposals. 

15 Naturally, the invention applies not only to the 

"visible" elements of a set relating to a multimedia 
document structured using the invention, i.e. not only to 
elements that can be seen by the user, but also to 
"invisible" elements such as timer elements or audible 

2 0 elements. 

A timer element may for example be used merely to 
trigger a stop- type action after a determined time, in 
particular in order to limit the time for which a 
determined graphics item is displayed, e.g. for 
25 displaying a button for a limited time. It may also be 
implemented in order to adapt the time allocated for a 
determined action in order to accommodate a speed change 
affecting the means for performing the action, in order 
to provide suitable matching. 

3 0 As described above, and according to an essential 

characteristic of the invention, the multimedia document 
made up of elements and of links is described in a 
description language . 

It is recalled that a description language is a 
3 5 computer language that, among other properties, has the 
property of being easy for a non- programmer to use. It 
makes it easy for a non-specialist to describe a 
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multimedia document, without requiring in-depth knowledge 
of programming techniques. 

The multimedia document as described in the 
description language can then be interpreted by a 
5 software module. The software module may be in the form 
of a browser, similar to those currently in existence for 
non-dynamic and non- interactive multimedia documents. 

In an implementation of the invention, the 
description language complies with the XML (extension 
10 Markup Language) Recommendation issued by the World-Wide 
Web Consortium (W3C) . That recommendation provides a 
grammar making it possible to define new description 
languages . 

More precisely, it is advantageous to make the 
15 description language as close as possible to the HTML 
language which does itself also comply with the XML 
Recommendation of the W3C. 

In this way, it is possible to minimize the learning 
period required by users who wish to write multimedia 
2 0 documents. 

The HyperText Markup Language (HTML) is defined by 
the W3C, and numerous bibliographic references on the 
subject can be found on the Consortium's Internet Site 
whose address is http://www.w3.org. 
25 The purpose of HTML is to describe static multimedia 

documents, i.e. documents that do not include aspects 
that are dynamic, and in particular interactive. 

In an implementation of the invention, the 
multimedia document includes a portion describing the 
30 elements and a portion describing the formalisms, and the 
associations between elements and formalisms may be 
established by means of indicators. 

Thus, it is easy for the software module 
interpreting the document to take into account the static 
35 portion only. This is particularly advantageous when the 
information-processing system in which the software 
module is installed is associated with a terminal that 
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has limited capabilities. For example, this applies to a 
terminal which has merely a monitor and no keyboard or 
mouse: the interactive aspects must not then be taken 
into account . 

5 A multimedia document of the invention may thus be 

made up of two distinct portions, the first portion being 
devoted to describing the elements. This portion is thus 
similar to a static description known in the state of the 
art and complying with HTML. However, it is preferable 
10 to add an identifier field to each of the elements in 

order to make it possible to associate the elements and 
the links which are described elsewhere in the document. 

An example of an element could be described as 
follows : 

15 <DIV id="controlComposite" x="110" y="300" width="180" 
he ight = "100" background - color = " # 9D9DFD " > 

<BTN id="playButton" x="0" y="0" 

icon-enabled= " buttons/play . gif " 

icon-disabled= "but tons /pi ayD . gif " 
2 0 icon-selected="buttons/playP . gif " /> 

<BTN id="pauseButton" x="60" y= " 0 " 

icon-enabled="buttons/f reeze . gif " 

icon-disabled= " but tons/ free zeD . gif " 

icon-selected= " buttons/ free zeP . gif " /> 
25 <BTN id="stopButton" x="60" y= " 0 " 

icon-enabled= "buttons/ stop . gif " 

icon-disabled= " buttons/ stopD . gif " 

icon-selected= "buttons/stopP . gif " /> 
</DIV> 

30 In this example, the element is a "composite" 

element identified by the name "controlComposite" , More 
precisely this composite element includes three 
"contained" elements identified by the names 
"playButton" , "pauseButton" , and "stopButton" . 

35 As is conventional in HTML, this "composite" element 

includes a plurality of attributes. These attributes 
relate to its location (x,y), to its dimensions (height. 
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width) , and to its appearance (background-color) . In 
addition to these known attributes, an identification 
attribute (id) is provided enabling the element to be 
given a name . 

5 In the same way, the three contained elements 

(playButton, pauseButton, and stopButton) include 
positioning attributes (x,y) , appearance attributes 
(icon-enabled, icon-disabled, and icon-selected) , and 
identification attributes (id) . 
10 The second portion of the multimedia document is 

devoted to the links, i.e. to the dynamic portion of the 
multimedia document. Each link may itself be made up of 
three portions: one devoted to events, one devoted to 
conditions, and one devoted to actions. 
15 An example of link could be described as follows: 

<LINK div= " controlComposite " > 

< SELECT I ON_EVENT target = "playButton" value="true" /> 
<RUN_CONDITION target = " controlComposite " 
value="true" /> 

2 0 <ACTION> 

<RUN target= "video" /> 
<SET_STATUS target= "pauseButton" 
status= " selec t ability " value="true" / > 
<SET__STATUS target = " StopButton" 
25 status= " selectability " value="true" /> 

<SET_STATUS target= "playButton" 
status= " selectability " value=" false" /> 
<SET_STATUS target= "playButton" status=" selection" 
value="true" /> 

3 0 </ACTION> 

</LINK> 

The link is identified by an identification 
attribute (div) and itself comprises three portions: 

The first portion, introduced by the keyword 
3 5 SELECTION_EVENT corresponds to the event of the 

ECA proposal corresponding to the link. In 
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this is example, this portion concerns 
selecting the play button. 

The second portion, introduced by the keyword 
RUN_CONDITION corresponds to the conditions of 
5 the link. In this example, it concerns 

verifying that the composite element that 
groups together the various contained elements 
(i.e. the three buttons) is actually running. 
Finally, the third portion, introduced by the 
10 keyword ACTION corresponds to the various 

actions of the link. In this example, there 
are two types of action: the action introduced 
by the keyword RUN which consists in starting 
to run an element (the "video" element in this 
15 example) , and the actions introduced by the 

keyword SET_STATUS which consists in modifying 
the values of element statuses (in this 
example, the " selectability" and "selection" 
statuses of the three buttons) . 
2 0 The keyword "target" refers to the target, as 

defined above, while the keyword "status" naturally 
refers to the above-defined status. 

The fact that the elements are organized 
hierarchically, i.e. by means of a "composite" element 
25 that can combine "contained" elements, offers a 

significant advantage: it is then possible to reproduce 
this structure on a terminal of the mobile telephone type 
by means of a tree structure of pages. For example, a 
page on the screen of the mobile telephone may correspond 
30 to a composite element. 

This application, as well as other possible 
applications can be implemented easily and simply by the 
software module that must be provided for the data- 
processing system with which it is associated. 



